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CONVERGENCE OF THE ALL-TIME SUPREMUM OF A LEVY 
PROCESS IN THE HEAVY-TRAFFIC REGIME 

K.M. KOSINSKI, O.J. BOXMA, AND B. ZWART 

Abstract. In this paper we derive a technique of obtaining hmit theorems for suprema 
of Levy processes from their random walk counterparts. For each a > 0, let {y„ : 
n > 1} be a sequence of independent and identically distributed random variables and 
{X'f'^ : i > 0} be a Levy process such that X^"' = y/"', EX^"' < and EX{"^ t as 
a J, 0. Let Sn = 51^^=1 ^^ • Then, under some mild assumptions, A(a) max„>o S^ — ^ 
A(a) supt>o Xj — > S^., for some random variable S$. and some function A(-). 
We utilize this result to present a number of limit theorems for suprema of Levy processes 
1-" , in the heavy-traffic regime. 

1. Introduction 

S^ ; For each a > 0, let X(") = {X^^ : f > 0} be a Levy process such that /x('') := EX("^ < 0. 

(-H \ Along with the Levy process X^") define X(°) = supi>o xf . Since n^"-' < assures that 

+H ' x^'^' drifts to — oo, the all-time supremum X^"-* is a proper random variable for each a > 0. 

Now if /i'") ^ as a ], 0, then X^"-' — > oo. From this fact a natural question arises: How 

fast does X'"^ grow as a J, 0? 

The main purpose of this paper is to answer the above question by considering the discrete 

(a) 



m 



K*" ' approximation of a Levy process by a random walk. For each a > 0, let {Yn : n > 1} 



in 
in 



c^ 



be a sequence of independent and identically distributed (i.i.d.) random variables. Put 
5(«) = maXn>oSi"'\ where si"^ = ELi ^i''^ -^J"^ = 0. We shall show that if y}"^ has 
the same distribution as Xf", then the limiting distribution of X^"' can be derived from 

^— ^ , the limiting distribution of S^""' . In doing so we shall utilize a bound by Willekens 25]. 

O ! Loosely speaking, this bound allows to derive certain properties of Levy processes via 

their corresponding random walk approximations (see also Doney |9|). The advantage of 
this approach is that the problem on how fast does S^""^ grow as a | has been treated 

K> , extensively and various methods have been developed. 

^ \ One major reason why the behaviour of S^°'' has been studied is that it is well known 

that the stationary distribution of the waiting time of a customer in a single-server first- 
come- first-served GI/GI/1 queue coincides with the distribution of the maximum of a 
corresponding random walk. The condition on the mean of the random walk becoming 
small (a ^ 0) means in the context of a queue that the traffic load tends to 1. Thus, the 
problem under consideration (in the random walk setting) may be seen as the investigation 
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of the growth rate of the stationary waiting-time distribution in a GI /GI /\ queue. This 
is one of the most important problems in queueing theory that is referred to as the heavy- 
traffic approximation problem. The question was first posed by Kingman (see [15| for 
an extensive discussion on the early results). It has been solved in various settings by, 
e.g., Prokhorov [1^, Boxma and Cohen [5[, Resnick and Samorodnitsky [20], Szczotka and 



Woyczyiiski [2j] and many others. 

Surprisingly, there are no results in the literature on the heavy-traffic limit theorems for 
Levy-driven (fluid) queues. Our approach however allows to translate each single result in 
the random walk setting to its analogue in the Levy setting, thereby providing a range of 
fluid heavy-traffic limit theorems. Our main result, [Theorem H states: under some mild 

conditions, A{a)S^"'' — > ^ if and only if A{a)X^"'' — )• ^, for some random variable ^ and 
some function A(-). 

The remainder of the paper is organized as follows. In [Section 21 we fix notation and give 
some necessary preliminaries. [Section "31 contains the main result of this paper. iTheoreniTt 
and its proof. Instances of this theorem applied to the results by Boxma and Cohen 



Shneer and Wachtel 



2ll ] and Szczotka and Woyczyiiski [23j (see also Czystolowski and 



Szczotka [8[) are presented in [Section 41 and conclude the paper. 

2. Preliminaries and notation 

All the stochastic objects are assumed to be defined on the probability space {0,, F, P) 
endowed with a standard filtration J^ = {J^t '■ t > 0}, that is J- is an increasing, right- 
continuous family of complete sub-cr-fields of F. Let us begin by fixing the notation for 
Levy processes. 

A real- valued stochastic process X = {Xt : t > 0}, with Xq = 0, is said to be a Levy 
process with respect to the filtration T if it is adapted to J-", Xs — Xt is independent of J-j 
and distributed as Xg-t for any <t < s. Moreover, we assume that the sample paths of 
X are cddldg (right-continuous with left limits), so that X is strong Markov. 
Let ip be the Levy characteristic exponent of X so that Ee* ' = e"*'^'"-' , for all u G M. In 
this case, for some cr > and S GM, ip has the form 

tpiu) = i6u + -a^u^ + I (1 - e^"^ + iux) u{dx) + [ (l - e^"^) v{dx), 
2 J\x\<i JM>'^ 

where u is the Levy measure (on M\{0}) satisfying f^{lAx'^)iy{dx) < cxd. We only consider 
nondeterministic processes X, which is synonymous with (T^-|-i/(M\{0}) > 0. We say that: 
X is centered if EXt = for all t; spectrally positive if z/(— oo,0) = 0; spectrally negative if 
1^(0, cxd) = 0. If Xi has a stable distribution with index a € (0, 2] then we say that X is 
an a-stable Levy process and denote it by .if''"^ For more background on Levy processes 
we refer the reader to P] and references therein. 
For an interval B C [0,oo), we denote by D{B) the space of real-valued cadlag functions 



on B equipped with the usual Skorokhod Ji topology; see, e.g., [ll|, Chapter VI]. 
In the sequel we will encounter the Mittag-Leffler distribution; see, e.g., [J, p. 329]. A pos- 
itive random variable J^ ^ a is said to have a Mittag-Leffler distribution with parameter 
a G (0, 1] if its Laplace-Stieltjes transform (LST) is given by 

1 



Eexp(-s^.ifa) 



l-Fs"^ 
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Observe that ^J£\ has the 1-exponential distribution. 

We will also make use of some standard notation. For two functions f,gwe shall write 

f{x) ~ g{x) as X ^- xq € [0, oo] to mean lim^^^a;;, f{x)/g{x) = 1. The class of regularly 

varying functions with index a shall be denoted by Mi^ a- 

In what follows we shall also write 

X(") = sup X^f^ , S(") = max S^^^ , 
t>o ">o 

where, for each a > 0, {X^ : t > 0} is a Levy process and Sn = Ylk=i '^k ^^ ^^^ "'^'^ 
partial sum of a sequence of random variables {Yn : n > 1} with Sq = 0. 

3. Main theorem 

Theorem 1. For each a > 0, let {Yn : n > 1} be a sequence of i.i.d. random variables 
and {X^ : t > 0} be a Levy process. Assume that for each a, Y^^ = Xj^ , /i'"' = KY-I^"" < 
and iM'"'' to as a J, 0. Then, for some random variable ■'%, 

(1) A(a) max S^") A ^ ^^ A(a) sup X^"^ A^, as a ^ 0, 

where A(-) is a normalizing function such that A{a)Xf' — ?> almost surely. 

Remark 1. The assumptions of the above theorem are natural: 

• //'"' t assures that, for each a, X^°'> and S^""^ are finite random variables. More- 
over, X^""' and S^""' tend to infinity with a. Therefore the function A(-) tends to 
zero and can be seen as the speed of convergence in ([1]); 

• A(a)X|" —7- is satisfied in all typical applications; for instance, when X^ = 
Xt — at for a fixed Levy process X, see lSection 4.11 and ISection 4.2t or there exists 
a function d{a) -^ oo such that X^,K^ ^^ X in D[0, oo), see lSection 4.31 

The distribution of the random variable M can be computed in several cases; we will get 
back to it in [Remark 41 

Proof of \Theorem 1\ With R{x) := 1 — R{x), where R is the distribution function of ^, it 
is enough to show that, as a 10, 

P (A{a)S^''^ >x) ^ R{x) ^^ P ('A(a)X('*) > x) ^ R{x), 

for any continuity point x of R. 

Assume that A{a)S^°'' — >■ ^, the converse implication follows in the same manner. 

Observe that S^""' = max„>oX„ . Thus, we trivially have 



(2) P (^A(a)x(") > xj > P (^A(a)S('^) > x 
On the other hand, for any xq > 0, 

'A(a)x('*) > x) < P ( A(a) maxX^'*) > x - xq J + P ( A(a)x('*) > x, A(a) maxX^'*) < 

= P (A(a)S(") > X - xo) + P ( A(a)X('') > x, A(a) maxX^'*) < x - xq) 



X — Xo 
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.(a) 



We use an argument similar to the^ne in 17|,|25[. Define t^'^'{x) = inf{t > : A{a)X^ > 
x}, so that T^^> is a stopping time [2', Corollary 8]. Now the second term on the right-hand 
side of the above inequality can be bounded from above by 

P fr(")(x) < oo, A(a) ( inf (x^,''^ - X%. .)) < -xo) 

= P fr^^^fx) < oo) P ( A(a) inf x}"^ < -xq] , 
V / V tG[o,i] / 

where we used the strong Markov property in the last equality. Thus, 

(3) P (A(a)x(") > x) P ( A(a) inf X^^"^ > -xq) < P (A(a)5(") > x - xq) . 

Now A{a)Xf' — )■ a.s. implies that the finite-dimensional distributions of {A{a)X^ : 



t € [0, 1]} converge to zero a.s. and thus by 2M the whole process converges to in 
Z)[0, 1]. Applying the continuous mapping theorem with the infimum (over [0,1]) map 
yields A(a) inf^grg^^i X^ — > 0. Thus, combining formulas ([2]) and 1^ we get 

R{x) < liminf P (A{a)X^'^'> > x] < limsupP (A{a)X^'=''> > x) < R{x - xq). 

The thesis follows by letting xq — >• 0. D 



Remark 2. In the following section, we shall use the i/part of [Theorem II to derive various 
limit theorems for suprema of Levy processes. It is worth noting however that the only 
if part could be used as well to derive limit theorems for suprema of random walks. A 
variation of this approach has been undertaken in Szczotka and Woyczyhski [23(], where 
first a heavy-traffic limit theorem is derived in continuous time and then this theorem is 
used to claim an analogous behaviour in discrete time. 

4. Special instances 

[Theorem II provides a tool for translating limit theorems for random walks to their ana- 
logues in the Levy setting. In this section we shall focus our attention on some seminal 
results about the convergence of the maxima of random walks and reformulate them to the 
Levy case. We illustrate each special case that we consider with a remark that explains an 
alternative way of obtaining the particular result via a direct approach undertaken in the 
literature. These remarks, albeit short, are rigorous enough to act as alternative proofs. 
Let us start with the case in which the underlying processes are spectrally positive, which 
is closely related to the queueing setting via the compound Poisson process. 

4.1. Spectrally positive processes. For a sequence of zero mean, i.i.d. random variables 
{Y, Yn : n > 1}, the question of how fast does S^"-' = max„>o(5'„ — na) grow as a | was 



first posed by Kingman |l3l.ll4l|. Kingman in his proof assumed exponential moments of |y| 
and used Wiener-Hopf factorization to obtain the Laplace transform of 5^'*'. Prokhorov 
[18l | generalized Kingman's result to the case when only the second moment of Y is finite. 
His approach was based on the functional Central Limit Theorem. These two approaches 
have become classical and have both been used to prove various heavy-traffic results. The 
analytical approach of Kingman was used by Boxma and Cohen [5| (see also Cohen [6|]) 
to study the limiting behaviour of S^"'' in the case of infinite variance. They proved that 
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if P(y > x) is regularly varying at infinity with a parameter a € (1, 2) (and under some 

additional assumptions), then there exists a function A(-) such that A{a)S^°'' converges in 

law to a proper random variable. 

[5J, Theorem 5.1] acts as the first application of our main result. For a Levy measure v 

define 



/>oo 

ris) := / {e~'"' -1 + sx) u{dx). 
Jo 



For a Levy process X = {Xt : t > 0}, let F be the distribution function of Xi and 
set F := 1 - F. With a > 0, ji, Theorem 8.2.1] asserts that F G £gy^a if and only 
if i/(a;,oo) € ^Y-a, where u is the Levy measure of X; moreover: F{x) ~ i^(x,oo), as 
X — > oo. This, combined with [5|, Theorem 5.1] and [Theorem 11 yields: 

Proposition 1. Let X be a spectrally positive Levy process such that z^(x,oo) G ^Y-^ 
for a € (1,2). Set p{a) = ^/a, where n = KXi, then 

A{p{a))snp{Xt - at) ^ ^^a~i, as /9(a) t 1, 

where A(x) = d{x)/fi and d{x) is such that 

(4) r(d(x)) -^ d(x) /u", as x t 1- 

X 

See also [5|, |20l for possible refinements of the assumption on regular variation in this 
special case. 

Remark 3. It is possible to prove Proposition 1 using a direct approach like the one in [5|]. 



Let X^ = Xt — at, a > fi, then the Pollaczek-Khinchine formula (see, e.g., [ij Chapter 
IX) yields 

Ee-^^<"' = ^ < oo, for A > 0, 

where v^a(A) = logEexp(— A(Xi — a)). Substituting ipa{^) = ^v'ai^) + ^(^) yields 

Ay^;(o) 1 



where we assumed a = for simplicity. Let A = sA{p{a)) with A(-) as in Proposition 1 
Using y, Theorem 8.1.6] one infers that, under the assumption z^(x,cxd) G ^"V -a-, t is 
a regularly varying function at with index a. We necessarily have d{x) J, 0, as a; f 1. 
Hence, as p(a) t 1, 



r(A) /s\"'^ ?^(f^(p(a))) s"-i r(d(p(a))) p{a) 






Ac/.;(0) \pj d{p{a)){a-p) /i" d(/>(a)) 1 - p(a) 
4.2. Asymptotically stable processes. Proposition 1| limits the class of Levy processes 



under consideration to spectrally positive. Further improvements of the result from [5| by 
Furrer [lO| and Resnick and Samorodnitsky 20] assumed that the random walk belongs to 



the domain of attraction of a spectrally positive stable law and relied on functional limit 



theorems. Shneer and Wachtel 2l| relaxed this assumption to allow the random walk to 
belong to the domain of attraction of any stable law. The main result from [21] acts as 
the second instance of an application of [Theorem II 
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Proposition 2. Let X he a centred Levy process such that the random variable Xi belongs 
to the domain of attraction of a stable law ^^ with index a G (1, 2]. That is, there exists 
a sequence {d{n) : n > 0} such that 

Xn d 



(5) 
Then, 



d{n) 



^l 



(a) 



as n ^f oo. 



1 



A(a) sup(Xt — at) ^ sup(^/" — t), as a i 0, where A(a) = 

t>o t>o d(n{a)) 

and n{a) is such that 

(6) an{a) 1^ d{n{a)), as a 1 0. 



Remark 4. It is well known that the sequence d{n) in Proposition 2 is regularly varying 



with index \/a. Therefore, Proposition 2 implies that, with Xf" = Xt — at, X^""' grows as 



a regularly varying function (at zero) with index — l/(a — 1). li ^^°'' is spectrally negative, 
then the distribution of ^ = sup(>o(.i?/° — t) is exponential; see, e.g., [3;, Proposition 5]. 
j£^(q) ^g spectrally positive, then, as seen in [ Proposition l[ the limiting random variable 
has a Mittag-Leffler distribution; see, e.g., [12, Theorem 4.2]. If ^^"^ is symmetric, then 



one can give the Laplace-Stieltjes transform of ^, see 231, Theorem 8]. In the other cases 
the explicit form of the distribution might be infeasible to compute; however, one can 
easily find its tail asymptotics P(^ > x) ~ Cx^~°'. For more details on the supremum 
distribution of a Levy process see [2c 



Remark 5. Shneer and Wachtel 2l| showed that both classical approaches, i.e., via Wiener- 
Hopf factorization and via a functional central limit theorem, can be applied to obtain their 
result. Moreover, the technical difficulties arising from these methods can be overcome 
using a generalization of Kolmogorov's inequality based on a result by Pruitt [l9[. A 



similar result is also available for Levy processes and can also be found in [li|]. Let us 
introduce V{x) = f, ,^^y'^i'{dy), the truncated second moment of the Levy measure z^. 
Under the assumptions of Proposition 2 V G ^^2-0- Moreover, [l9|. Section 3] asserts 



that there exists a constant C such that 

^tV{x) 



(7) 



SUpXs 
s<t 



> x] <C- 



Using the regular variation of V, ^ and d?]), for any fixed T > there exist constants 
Ci , C2 > such that 



sup {Xt 

yt>n{a)T 



at) > ) < X] ] 



fc=0 



sup Xt > 2''an{a)T 

,t<2'=+ln(a)T > 



(8) 



^^^y(an(a)r)g^(,.)i- 



a^n[a)T 



< c/'5"'°>.»,.(a)r'-°. 



fc=0 



c^{n{a)) 



The sequence d{n) can be defined as d{n) := inf{t > : V{t) < t'^/n}, therefore the last 
expression tends to zero, uniformly in a > 0, as T tends to infinity. This, combined with 
the classical functional limit theorem corresponding to ([5]) and the fact that for a fixed 



T > 0, supremum on [0, T] is a continuous map, yields the thesis of [Proposition 2 
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On the other hand, as a consequence of the Wiener~Hopf factorization (see [isl . Chapter 
6]), with Xf ^ = Xt- at, the LST of X(") is given by 

Ee-^^*"' = exp (- T-E^l- e-M^"(«)t-»'^W*), X^^a)t - an{a)t > o) dt) . 

Plugging in A = A(a)s for s > 0, from ([5]) and ([6]) it follows that, as a | 0, this expression 
tends to 



°° 1 - ^^ -s{J^}"^-t) M») 



Ee-'^ = exp ( - / - E (^1 - e"^^-^* -'> , ^^ -t>0) dt 

the LST of .^ = supj>Q(Jfj — t), provided that we can interchange the limit with the 
integral. This follows by using the dominated convergence theorem. For big values of t, 
say t > T and some C3, C4 > 0, we can estimate the integrand by (cf. ([7]) and ([8])) 

1^/,^ / x \ ^V(0'n(a)t) ^ ^V(d(n(a))) , , ^ „ 

-P (X„,„„ > an(a>t) < C^^ < Ct-" A±±Mnia) < Ct- . 

For t <T and some C5 > 0, one can simply bound the integrand by (cf. ([7])) 

C5si'/°"'E(^i("\^/")>0). 

4.3. Heavy-trafRc invariance principle. A general principle called heavy-traffic invari- 
ance principle has been established by Szczotka and Woyczyhski [23|; see also [7|, |8|, |24 |. 
This principle asserts under what condition one can infer the limiting distributions of 
maxima of random walks from functional limit theorems. According to [Theorem II this 
principle can be also reformulated to the Levy setting. Therefore we conclude the paper 
with the following theorem: 

Proposition 3 (Heavy-traffic invariance principle). For a family of Levy processes {X^ : 
t > 0} denote ^^°'' = EX|" < and assume that fi^""^ t 0- Moreover, assume that there 
exist functions d[-) and A(-), such that the following conditions hold: 

(I) (i(a)A(a)|^('*)| ^ /3 G (0,oo); 

(II) A(a){xJ^)^ - td{a)fi^'''> : t > 0} ^ {Xt : t > 0} in D[0,oo), where X is a Levy 

process; 
(III) the family {A(a)X(") : a > 0} is tight. 

Then, 

A(a) supX^^"^ A sup {Xt - pt) . 

t>0 t>0 



See 23|, Theorem 2] for an extension to processes X^""' with stationary increments in the 
case X is stochastically continuous. 
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